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POLYNOMIALS DEFINED BY TABLEAUX AND LINEAR 

RECURRENCES 


PER ALEXANDERSSON 


Abstract. We show that several families of polynomials defined via fillings of 
diagrams satisfy linear recurrences under a natural operation on the shape of the 
diagram. We focus on key polynomials , (also known as Demazure characters), 
and Demazure atoms. The same technique can be applied to Hall-Littlewood 
polynomials and dual Grothendieck polynomials. 

The motivation behind this is that such recurrences are strongly connected 
with other nice properties, such as interpretations in terms of lattice points in 
polytopes and divided difference operators. 
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1. Introduction 

Using a similar technique as in [Ale 14], we provide a framework for showing that 
under certain conditions, polynomials encoding statistics on certain tableaux, or 
fillings of diagrams, satisfy a linear recurrence. We prove that several of the classical 
polynomials from representation theory fall into this category, such as (skew) Sclrur 
polynomials and Hall-Littlewood polynomials. 
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The main concern in this paper are the so called key polynomials, indexed by 
integer partitions, and atoms. The key polynomials are natural, non-symmetric 
generalizations of Schur polynomials and are specializations of the non-symmetric 
integer form Macdonald polynomials, see [Mas09] for details. 

Let A be a fixed diagram shape, (a partition shape, skew shape, etc.) and let 
P/ c a(x), k = 1 , 2 ,..., be a sequence of polynomials which are generating functions 
of fillings of shape kX. For partitions, kX is simply elementwise multiplication by 
k. There are several reasons why one would be interested in showing that a such 
sequence satisfies a linear recurrence: 

(1) To obtain hints about the existence or non-existence of formulas of certain 
type. For example, the Weyl determinant formula for Schur polynomials 
implies that the ordinary Schur polynomials satisfy a linear recurrence. 

(2) To obtain evidence for alternative combinatorial interpretations of the 
tableaux involved. For example, the skew Schur polynomials can be obtained 
as lattice points in certain marked order polytopes, called Gelfand Tsetlin 
polytopes. Such a polytope interpretation implies the existence of a linear 
recurrence relation. 

(3) To prove polynomiality in k of the number of fillings of shape kX. 

(4) To obtain results about asymptotics. For example, in [Alel2] we used 
such recurrences to give a new proof of a classical result on asymptotics of 
eigenvalues of Toeplitz matrices. 

In the last section, we provide several examples of polynomials that satisfy 
such linear recurrences. We also sketch two additional proofs in the case of key 
polynomials, to illustrate that several nice properties imply the existence of a linear 
recurrence relation. These methods are based on a lattice-point representation and 
an operator characterization of the key polynomials. There is no straightforward 
way to check if a family of polynomials have such characterizations, but it is easy to 
generate computer evidence that a sequence of polynomials satisfy a linear recurrence. 
Thus, proving the existence or non-existence of linear recurrence relations is an 
informative step towards alternative combinatorial descriptions of the family of 
polynomials. 

Acknowledgements. The author would like to thank Jim Haglund for suggesting 
this problem. This work has been funded by the Knut and Alice Wallenberg 
Foundation. 


2. Diagrams and fillings 

A diagram D is a subset of {(i,j) : i,j > 1} which realized as an arrangement of 
boxes, with a box at (i,j) for every (i,j) in D. Here, i refers to the row and j is the 
column of box (i, j) and we draw diagrams in the English notation. For example, 
D = {(1,1), (1,3), (1,4), (2,2), (3,2)} is shown as 
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A filling is said to have l rows, if row l contains a box, but every row below row l is 
box-free. 

Given an integer composition a = (or, ..., cq), the diagram of shape a, D a , is 
given by D a = {( i,j ) : 1 < j < oti , 1 < i < l}. If /3 = (/?i, is another integer 
composition such that a D (3, that is, a,; > /?,; for all i, then the diagram of shape 
a/f3 is given by the set-theoretical difference D a \ D f 3 , and is denoted D a /p. Finally, 
if D is a diagram, let kD be the diagram obtained from D by repeating each column 
in D k times, that is, 

kD = |J {(i,kj - k + l),(i,kj -k + 2),...,(i,kj)}. 

Note that kD a jp D^^j^p. 


2.1. Fillings. A filling of a diagram is a map T : D N, which we represent by 
writing T(i,j) in the box (i,j). For example, 


1 

8 




X 

X 

9 

1 


X 

X 

5 



X 





X 

X 

X 

9 

2 

7 


is a filling of the diagram with shape (2,4, 3,1, 6 )/(0,2,2,1,3), where the places 
marked x correspond to boxes in Dp. The shape of a filling refers to the shape of 
the underlying diagram. 


The jtli column in a diagram D with l rows has a shape define as the integer 
composition (si,..., Si), where .s, = 1 if (i,j) € D and 0 otherwise. Thus, if a is 
an integer composition with only 0 and 1 as parts, then the first column of D a has 
shape a. Whenever a is an integer partition, D a is called a Young diagram and 
any filling of a Young diagram is called a tableau. A filling with shape a/p where 
both a and /? are partitions, is called a skew tableau. 


Given a diagram or a filling, we can duplicate or delete columns. For example, 
deleting the fourth column and duplicating the third column in the filling in Eq. (1) 
results in the filling 


1 

8 


X 

X 

9 

9 

9 

X 

X 

5 

5 

5 


x x x x x 


2 7 


( 2 ) 


Note that if the original filling T has shape D a /p, then duplication and deletion on 
T will result in some T' of shape D a i/p>. This is straightforward to prove. 


2.2. Column-closed families of fillings. In most applications, one are interested 
in a restricted family of fillings, perhaps tableaux or skew tableaux, together with 
some conditions on the numbers that appear in the boxes. Note that a filling T 
can be viewed as a concatenation of its columns — some of which might be empty. 
Obviously, T can only be expressed in one such way if we require that the last 
(rightmost) column is non-empty. 
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Let (Ci,..., Ci) be a filling with columns Cj,..., C; and let (rniCi,..., miCi ) 
denote the filling with mi copies of the column Ci, followed by m 2 copies of C 2 and 
so on. Finally, the concatenation, ~, of two fillings (Ci,..., Ci) and (C(,..., C[,) is 
simply given by 

(C'i, • • •, Cl) ~ (C'i,..., <7/0 = (C l5 ..., Ci, Ci,..., C//). 

Definition 1. A family of fillings, T, is said to be weakly column-closed if 

(Ci,..., Ci ,..., Ci) e T if and only if (miCi,..., miCi) € T (3) 

holds for every combination of integers m, where to, > 1. The family T is said to 
be strictly column-closed if Eq. (3) holds for every combination where rn, > 0. That 
is, the family is closed under deletion of any column. 

Less formally, T is weakly column-closed if it is closed under column duplication, 
and reduction of duplicate columns. The family is strictly column closed if it, in 
addition, is closed under removal of any column. 

Combinatorial objects would not be interested if it weren’t for combinatorial 
statistics. A combinatorial statistic on a family T is a map <7 : T —> N s . We will 
study a special type of statistics on fillings: 

Definition 2 . A combinatorial statistic a on a weakly column-closed family T is 
affine if 

<r(mi(7i,..., miCi) = A + S iWi + S 2 m 2 -\ - 1 - S/W; 

for all choices of m* > 1, where A and S t are vectors in N s . Similarly, a defined on 
a strictly column-closed family T is linear if 

cr(miC'i,... ,miCi) = Simi + S 2 m 2 + • • • + Simi 

for all choices of m; > 0. Note that this is equivalent with the statement that 
er(Tj ~ T 2 ) = cr(Tj) + a(T 2 ) for every pair T\, T 2 of fillings such that T\ ~ T 2 is in 

r. 


Note that the statistic given by w(T) = (wi,w 2 , ..., w n ) where Wi are the number 
of boxes filled with i in T is a linear statistic. This is usually called the weight of T. 
Finally, two statistics ay : T —> N Sl and a 2 : T ^ FF 2 can be combined into a new 
statistic a in the obvious manner as cr(T) = (<ji(T), cr 2 (T)), which map to N Sl+S2 . 

3. Properties of linear recurrences 

We first recall some basic notions about linear recurrences. This can be seen as 
analogous to the theory of linear differential equations. 

A sequence {afc(x)}£L 0 of functions are said to satisfy a linear recurrence of 
length r if there are functions Ci(x),..., c r (x) such that 

Ofe(x) + Ci(x)o fe _i(x) -I-1- c r (x)a fc - r (x) = 0 

for all integers k > r. The polynomial (in t) 

X(t) =t k + Ci(x)t fe_1 +-1- c r _! (x)t + c r (x) 


( 4 ) 
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is called the characteristic polynomial of the recursion. If the characteristic polyno¬ 
mial factors as (t — Pi) mi ■ ■ • (t — p r ) mr , where all Pi(x) are different , then one can 
express a*,(x) as 

r mi — 1 

«fc(x) = ^(pz(x)) fc (5) 

;=i j =o 

for some functions gu{x), that only depend on the initial conditions, that is, the 
functions ao( x ) to a r _i(x). In the other direction, any sequence of functions which 
are of the form given in Eq. (5) satisfy a linear recurrence with x{t) as characteristic 
polynomial. Notice that the Ci are elementary symmetric polynomials in the pi , 
with some signs. 


From now on, we are only concerned about sequences where the a k (x) and 
pj(x) are polynomials, which implies that the c*(x) are polynomials and the gu(x) 
are rational functions. Let a k (x) and b k (x) be sequences of polynomials with 
characteristic polynomials given by J|.(t — p i (x)) Pi and JI-(t — pi(x)) qi respectively, 
where some of the pi or qi may be zero. Then, as sequences for k = 0,1,..., 






h(x)a k (x) satisfy the same linear recurrence as a k (x), where h(x.) is any 
polynomial, 

Ofc(x) + b k {x) satisfy a linear recurrence with characteristic polynomial given 

by 


II(*-*( x » 


max(pi ,qi) 


i 


• Ofc(x) • 6 fc(x) satisfy a linear recurrence with characteristic polynomial given 

by 


li; (t-pi(x)p j (x)) p *+«- 1 . 


id 

Pi > 1 qj > 1 


However, if p il (x)p jl (x) = p h (x)p h (x) for some (* 2 ,^ 2 ), some 

roots of the characteristic equation can be removed — details are left as an 
exercise. As an example: 


o fc (x) = (1 + k 3 )(5x) k , b k (x) = (2 + k 2 - k 4 )(2x - l) fc 


satisfy linear recurrences with characteristic polynomials (t — 5a ;) 4 and 
(t — (2x — l)) 5 respectively. The product, ak{x)bk(x) = (1 + /c 3 )(2 + k 2 — 
/c 4 )(10a ; 2 — 5x) k satisfy a linear recurrence with characteristic polynomial 
(t - (ICte 2 - 5a;)) 8 . 

• a s fe(x) with s a fixed positive integer satisfy a linear recurrence with charac¬ 
teristic polynomial given by 


n(t-Mx)T 


The proofs for these statements follows from writing Ofc(x) and 6 / c (x) in the form 
Eq. (5) and examining the expressions above. Note that if a k {x ) and 6 fc( x ) have 
characteristic polynomials with simple roots, then so does h(x) • a k (x), Ofc(x) + 6 fc(x), 
Ufe(x) • b k (x) and a sk (x). 

Finally, the definition of a sequence satisfying a linear recurrence in Eq. (4) does 
not provide an easy method to check for a linear recurrence if the Ci are unknown. 
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A useful shortcut might then be the following observation: a sequence {afc(x)}^ =0 
satisfy a linear recurrence of length r if and only if the following r x r-determinant 
vanish for all k > r — 1: 


Ofc 

a k ^i 

CLk—r+l 

Rfc+i 

a k 

Clk—r+2 

n k +r— 1 

n k +r—2 • • 

a k 


This classical trick can be found in e.g. [Lyn57]. 

3.1. Tableaux and linear recurrences. 

Lemma 3. Let T be a weakly column-closed family of fillings and T = (C i,..., Ci ) 
is a fixed filling in T, where no adjacent columns are equal. Let a : T —> N n be a 
linear combinatorial statistic such that 

a(aiCi ,..., aiCi) = a 1 S 1 + a 2 S 2 H-b aiSi. 

Define the sequence of polynomials 

F fc (z) = z CT (“iC' 1 ,... > a i c i ) and = (_l)l+l. 

a^> 1 

a i+ a 2H-h ai—k 

Then {F k (z)}£Lo sa ^ s fy a linear recurrence, with characteristic polynomial 

(t-z Sl )(t-z S2 )---(t-z Sl ). (6) 

Proof. Note that the definition of Fk(z) implies that Fk( z) = 0 whenever 1 < k < l, 
and that F;(x) = z Sl_t ^ Sl . These are l conditions and it is easy to see that if 
we have a characteristic polynomial of the form (6), then -Fo(z) must be equal to 

Any tableau of the form (aiCi,..., aiCi) where a,; > 1 and cq + a 2 + • • • + 
ai > l, must have some a* > 2. Thus, this tableau can be constructed from 
some (aiCi,..., (dj — 1 )Ci ,..., aiCi ) by duplicating column C t . However, there 
might be several ways to do this. By using an inclusion-exclusion argument, it is 
straightforward to show that 

F k+ i(z) - (z Sl H-b z Sl )F k +i~\(z) H-b (-l)'(z Sl • • • z Sl )F k (z) = 0 

for all k > 0. Note that the coefficients are the elementary symmetric polynomials, 
evaluated at z Sl ,... ,z Sl , so factoring the characteristic polynomial gives exactly 
the expression in (6). □ 

Lemma 4. Let T be a weakly column-closed family of fillings, and let the T( a) £ T 
be given as 

T{ a) = T\ ~ (aiiCn,..., aiqCiq) ~ T 2 ~ (a 2 iC 2 i,..., a 2 i 2 C 2 i 2 ) ~ ... 

^ Tjn ^ • ■ • j Cm,l m ) ^ Tm-(-1 

where each Ti is some fixed (possibly empty) filling and no adjacent columns in each 
(C,i,... ,Ciif) are equal. Furthermore, let a : T —> N" be an affine combinatorial 
statistic, such that 

°’(^ 1 ( a )) = A + anSii + • • • + 
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Let a = (or, ..., a m ) be a fixed integer composition and define the polynomial 

G a ( z) = z CT(T(a)) and G 0 (z) = -(-l) il+ * 2+ '" + *”‘z A 

^ 1 

an+ai2-\ -b au i =ai 

where the sum is over all aij > 1, 1 < i < m, 1 < j < suc/i that a.n+- ■ ■+au i = ai. 
Then 

m 

G ka (z)=z A Y[Fi ai (z) where Fi(z)= £ z ciS il +-+c i s i , i; Fo(z) = 

i— 1 Ci>l 

ciH-hQ^/c 

Proof. This is immediate from the the definition of er and the Ff( z), by simply 
substituting the definition of Ff(z) in the product and recognizing the expression 
for er. □ 

Note that the integer composition a should not be confused with some shape of 
a tableau. The composition a rather serves as the number of columns there are in 
each of the m “blocks” of columns in T(a). The functions Gfc Q (x) can now be seen 
as the generating functions of tr, as the block sizes grows linearly with k, and each 
block i consists of column fillings with columns from {Cn,... ,G,;i ; }, each present 
at least once. However, note that if all Ti are empty fillings (no columns), then 


a i Oi 2 0:3 


Figure 1. The role of a. Here, all T) are empty. 


Gfea(x) can be seen as generating function for fillings of shape kD for some fixed 
diagram D as in Fig. 1. In the proof of Proposition 6, the relation between a and 
D is explained in more detail. 


Corollary 5. {Gfc a (z)}^_ 0 satisfy a linear recurrence with characteristic polynomial 
given by 

JJ (t - Z aiSl ^ Z a2S2 i2 . . . ) _ ( 7 ) 

i<h<*i 


1 <jm<lm 


Furthermore, if a is linear, then Eq. (7) can be expressed as 
J~~J’ _ z <?(aiC ljl ,a 2 C 2 j 2 ,...,a m C m j m ) 


i<h<Zi 

1 < J 2<^2 


(8) 


1 <j m <lm 

Multiple roots can be disregarded if {<S)i,..., 5)^} are all distinct for every i. 
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Proof. Each F%( z) can be seen as generated by a linear statistic a'(T) = o(T) — A. 
Therefore, each of these satisfy a linear recurrence, according to Lemma 3. The 
theory of linear recurrences now imply that the Gk a { z) also does, with a characteristic 
polynomial as described above, since G a is essentially a product of the F l . 

Eq. (8) follows from linearity of a together with the definition of a. Note that 
the value of a(aiCij 1 , ,..., a m C m: j m ) is defined by linearity a, but that the 

tableau we evaluate on might not be in T (if some a, = 0) unless this family is 
strictly column closed. The statement about simple roots follows immediately from 
the theory of linear recurrences. □ 

So far, we have only treated generating functions of subsets of tableaux where the 
columns are from a specified subset and each column appear at least once. We will 
now treat the case where only the family of fillings and the diagram shape defines 
the generating function. To do that, it is natural to restrict ourself to a special type 
of families of fillings. 

A family T is said to be well-behaved if every filling T £ T satisfies the following 
two properties: 

• if two columns in T are identical, then all columns in between are also 
identical to these two. 

• if two columns C\ and C 2 are different and C\ appears to somewhere the left 
C2, then C\ never appears to the right of C 2 in some other filling T' £ T. 

For example, fillings such that every row is weakly decreasing (or increasing) are 
well-behaved. 

Proposition 6. Let T be well-behaved weakly column-closed family of fillings and 
let a be an affine statistic defined on T. Let D be a fixed diagram and define the 
polynomials as 

h d(z) = Z<T(T) 

TeT(D,n) 

where T(D,n) is the set of all fillings in T with shape D and for every box ( i,j) 
in such a filling, we have 1 < T{i,j) < n. Then {HkD{z)}^ =1 satisfy a linear 
recurrence. Furthermore, if a is linear, then the characteristic polynomial of the 
recurrence is given by 

n(*- z " (T) ) (9) 

T 

where T runs over all tableaux of shape D such that any adjacent columns of same 
shape in T are identical, and each T can be obtained from some T(kD , n) by deleting 
some columns. Note that T might not itself be an element in T. However, if T is 
strictly column closed, then each such T is in T(D,n). 

Proof. Note that every column in kD has the same shape as some column in D. 
Since we may only fill boxes with entries from [n], there is a finite number columns 
that can appear in F(kD,n). Furthermore, since T is well-behaved, there is a, finite 
number of lists of columns, (Ci, C 2 , • ■ •, Ci), such that all Cj are different and Ci 
never appears to the right of Cj in some filling in T ", whenever i < j. Thus, for 
every k, every filling in 7 ~(kD,n) can be obtained in a unique way from such a list, 
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by duplicating some columns in that list. Hence, H^d (z) can be expressed as a 
finite sum over such lists (C\, C 2 , ■ ■ ■, Ci ), where each term corresponds to fillings 
T of shape kD where each column in T is in the list and every column in the list 
appears at least once in T. 

More specifically, let the diagram D be expressed as the concatenation D = 
(aqsi, C 12 S 2 , ■ ■ ■, a m s m ) where the s* are column shapes and s* ^ s*+i (here, we use 
the same notation as for filled columns). Then every filling in T(kD,n) can be 
obtained in a unique way as 

(«llCn, . . . ,au 1 C'i; 1 ) ~ (CI 21 C 2 I 1 • • • ,CL2l 2 C2l 2 ) ~ ~ («ml Cml 

where each CV, has shape s,; and an + ■ ■ ■ + ai t i i = a,. Hence, Hkjofx., t) can 
be expressed as a sum over polynomials of the same form as Gka in Lemma 4. 
Corollary 5 tells us that each Gka satisfy a linear recurrence, so the sum of such 
sequences must too. This proves the first statement in the proposition. 

The second statement follows from Corollary 5 and observing that the S i:) in 
Eq. (7) can be replaced by cr(Cij), since er is linear. The observation that it is enough 
to only consider tableaux where adjacent columns of same shape have identical fillings 
is a consequence of the combinatorial interpretation of the F’ ka (z) in Lemma 4 
a block of size fccq must have copies of some column if k is sufficiently large and 
now a similar inclusion-exclusion reasoning apply as in Lemma 3. □ 

Corollary 7. Let (er, r) be an affine statistic, such that the restriction to a is linear 
and a (Ci) 7 ^ cr(C 2 ) => C\ 7 ^ C 2 for any pair of columns that appear in a filling in 
T. Then the characteristic polynomial in (9) can be taken to have only simple roots. 

Proof. The fact that er(Ci) ^ a(C 2 ) =>■ C\^ C 2 implies that the values of the S,j 
in (7) are all distinct. Since {Tfe£ ) (z)}^i 1 can be expressed as a sum of sequences, 
each of which has simple roots in its characteristic polynomial, the statement follows 
by using the theory in Section 3. □ 

4. Augmented fillings 

This section introduce the diagram fillings that are responsible for key polynomials, 
Demazure atoms and Hall-Littlewood polynomials. We follow the terminology in 
[HLMvWll, Mas09], with a few minor modifications. 

Let /? = (/?i,..., (3 n ) be a list of n different positive integers and let a = 
(or,... ,a n ) be a weak integer composition, that is, a vector with non-negative 
integer entries. An augmented filling of shape a and basement f3 is a filling of 
a Young diagram of shape (or,..., a n ) with positive integers, augmented with a 
zeroth column filled from top to bottom with ..., /3 n . 

Definition 8. Let T be an augmented filling. Two boxes a, b, are attacking if 
T(a) = T(b) and the boxes are either in the same column, or they are in adjacent 
columns, with the rightmost box in a row strictly below the other box. 


a 


a 



or 



b 



b 
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A filling is non-attacking if there are no attacking pairs of boxes. 

Definition 9. Let T be an augmented filling with weakly decreasing rows. An 
inversion triple of type A is an arrangement of boxes, a, b, c, located such that a is 
immediately to the left of b, and c is somewhere below b, and the row containing a 
and b is at least as long as the row containing c and T(a) > T(c ) > T(b). 


Similarly, an inversion triple of type B is an arrangement of boxes, a, b, c, 
located such that a is immediately to the left of b, and c is somewhere above a, 
and the row containing a and b is strictly longer than the row containing c and 
T{a) > T(c) > T(b). 


Type A: 


a 

b 


c 


Type B: 



( 10 ) 


Warning! This definition slightly different from what is stated in [HLMvWll]. 
However, the definitions coincides whenever the rows in the filling are weakly 
decreasing and we are only concerned with that special case. 

Definition 10. A semi-standard augmented filling, (ssaf) of shape a and basement 
fi is an augmented filling of shape a and basement (3 with weakly decreasing rows 
and without any inversion triples. 

Note that this definition implies that there are no attacking boxes in an SSAF. In 
particular, all entries in every column are different. 

Example 11. Here is an example of a semi-standard augmented filling, with 
basement (1,3,2, 5,4). 


1 




3 

3 

1 

1 


2 

2 



5 

5 

5 

5 


4 

4 

4 

3 

2 


We can for example check the underlined entries for the type B inversion triple 
condition — since 4 < 1 < 3 is not true, they do not form such a triple. It is left as 
an exercise to check that no other triples are inversion triples. 

Lemma 12. The semi-standard augmented fillings is a weakly column-closed, well- 
behaved family. 

Proof. It suffices to show that duplication of a column in a SSAF T do not introduce 
any inversion triples and it is enough to check that there are no inversion triples in 
adjacent and identical columns. 

Assume that a, b, c form an inversion triple, as in Eq. (10) (either type). Since 
the columns are identical, T(a) = T(b ) which implies T(a) = T(c) = T(b). However, 
this is means that two boxes in the same column are identical, so they are attacking. 
This contradicts the fact that the filling is a SSAF. □ 

Let SSAf(/3, a) be the set of all semi-standard augmented fillings with basement 
/? and shape a. Note that SSAf(/3, a) is a finite set. Given an augmented filling T, 
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let w(T) = (u>i,... ,w n ) where Wi count the number of boxes with content i not 
including the basement. The generalized Demazure atoms are defined as 

•4/3,«(x) = xW(T) - ( n ) 

TesSAF( / 3,a) 

The special case when Pi = i corresponds to the ordinary Demazure atoms, intro¬ 
duced by Lascoux and Schiitzenberger in [LS90] under the name standard bases. 

Let NAWF(a) denote the set of all non-attacking augmented fillings of shape a 
with weakly decreasing rows and basement given by Pi = i. The non-symmetric, 
integral form Hall-Littlewood polynomials, E a (x i,... ,x n ), may be defined as 

E a (x;t)= x w ( T k coinv(T) (l -t) dn(T) ( 12 ) 

TGNAWF(a) 

where coinv(T) is the number of triples in T which are not inversion triples, and 
dn(T) is the number of pairs of adjacent boxes, (i,j) and (i,j + 1 ) such that 
T(i, j) 7 ^ T(i,j+ 1) (different neighbors). This formula was first given in [HLMvWll]. 
It is straightforward to show that the NAWF form a weakly column-closed and well- 
behaved family. They show that the ordinary Hall-Littlewood polynomials P M (x;t) 
can be expressed as 

P p (x;t)= ( 13 ) 

A»=A(t) 

where A(y) is the unique integer partition that is obtained from the weak integer 
composition 7 by sorting the parts in decreasing order. 

Lemma 13. The statistics dn and coinv are affine statistics. 

Proof. It follows immediately from the definition of dn that if dn(Ci,..., Cf) = A, 
then dn(miCi,..., m/C 1 /) = A for all mi > 1, so this is affine. The fact that coinv 
is affine is also quite straightforward and is left as an exercise to the reader. □ 


Using Proposition 6 , Lemma 12 and Corollary 7, we have the following result: 

Corollary 14. The sequences Al/ 3 > / SQ (x) and Pfc a (x; t) for k = 1,2,... satisfy linear 
recurrences with simple roots. 


Note that Eq. (13) implies that the ordinary Hall-Littlewood P polynomials 
satisfy a linear recurrence. These are usually (see [Mac95]) defined as 




m\(i) 


nn 

C>0 3 = 1 


1 - t 
1 ~ P 


5> 

ertzSn 





(14) 


where A = (Ai,..., A„), some parts might be zero and m\{i) denotes the number of 
parts of A equal to i, and <7 act on the indexing of the variables. 

Observe that from this definition, it is quite clear that {P/ca( x U)}/cLi satisfies a 
linear recurrence, since for a fixed a in (14), the expression is of the form g(x; t)a(x) x 
where g is independent under A 1 —> kX. Now compare with Eq. (5) above. 
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4.1. Key tableaux and key polynomials. Let a = (a±,... ,a n ) be a weak 
integer composition. To any such composition, construct a composition with unique 
entries, /3, and a partition A as follows: Create an augmented Young diagram with 
shape a and fill the zeroth column with the numbers 1,..., n in decreasing order. 
Remove all rows for which cq = 0 and sort the remaining rows according to the 
number of boxes, in a decreasing manner. If two rows has the same number of boxes, 
preserve the relative order 1 . The resulting diagram has the shape of a partition, 
A, which we denote A(a), and the zeroth column will be our basement /3(a). It is 
easy to show that this process can be reversed, that is, to any pair (/3,A), there 
is a corresponding a. Finally, note that /3(fca) = /3(a) and A (ka) = k\(a) for 
non-negative integers k. 


This correspondence is illustrated in Eq. (15), for a = (0,2, 3,4,2,0,1) and the 
tuple j3 = (4,5,6,3,1), A = (4,3,2,2,1). 



4 





5 





6 




3 




1 





(15) 


The key polynomials generalizes the Scliur polynomials and are indexed by integer 
compositions. They can be defined as 

/C Q (x) = ^2 x w{ - T) . (16) 

TesSAF(/3(a),A(a)) 

Note that the key polynomials are a subset of the generalized Demazure atoms. This 
motivates the definition of a key tableau as a semi-standard augmented filling of 
partition shape, and we let KTAb(/3, A) = SSAF(/3, A) to emphasize that this subset 
is of special interest. Note that we only need to be concerned about inversion triples 
of type A since we are dealing with partition shapes. 

Given a column (/3i,..., /3 n ) and a set of entries {ci,..., c n }, there is at most 
one one way to arrange the entries C\ ,..., c n in a column next to /3 such that the 
result fulfills all properties of a key tableau. First of all, it is easy to see that a 
necessary condition is that /3j > Ci for all i, for some enumeration of the Cj, in order 
to have decreasing rows in the result. 

Secondly, the lack of inversion triples in a key tableau implies that the order of 
the entries in the second column is unique; if (a, 6, c) is an inversion triple of type A, 
then transposing the entries in box b and c yield a non-inversion triple. This defines 
a total order among the elements in the second column, so there can be at most one 
filling where the second column (as a set) consists of the entries Ci,..., c n . 

The following lemma shows that under the obvious condition that if /3j < c,; for 
all i, then the Ci can be arranged in such a way that the columns form a proper key 
tableau with basement /3. We prove a stronger statement: 

1 Although, in this paper, this convention will not be important. 
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Lemma 15. Let T be a Young diagram of partition shape 1 + A, filled with positive 
integers in such a way that each row is weakly decreasing, and each column contains 
unique entries, and the first column is given by fi. Then each column in T can be 
sorted in a unique way such that the result is a key tableau of with shape A and 
basement (3. 

Proof. We do the proof in several steps. The first case we cover is the case when all 
parts in A has the same size, that is, all columns of T has the same height. It is 
easy to see that in this case, we only need to show the statement for two columns. 
Thus, assume (/?i,..., /3„) and (ci,..., c n ) are given, with > Ci for all i. 

We now perform the following sorting procedure on the second column. Let Ci 
be the largest entry in the second column such that fii > c*, and transpose C\ and 
Cj. Since Ci > ci, the rows are still weakly decreasing after this transposition. Note 
that fix and Ci cannot be involved in an inversion triple later on: if there is some Cj 
such that fii > Cj > Ci, this would violate the maximality of the choice of c^. 

We now proceed recursively on the remaining entries of the two columns, 
( 02 , ■ ■ ■, fin) and (c 2 ,..., c n ) where we have performed a transposition in the second 
column. 

To handle tableaux with more than two columns, simply apply the permutation 
that takes the original column c to the result on all subsequent columns. The result 
will now still be a tableau with weakly decreasing rows, but the first two columns 
do not contain any inversion triples. Proceed with the same method on column 2 
and 3, then 3 and 4, and so on. 

Note that if Ci < C 2 < • • • < c r < fii for all i, and c r < Cj for all j > r, then the 
second column after the above procedure will end in the sequence c r , c r _i,..., Ci, 
reading from top to bottom. Thus, to turn an arbitrarily shaped tableau T into 
a key tableau, we first augment each column with negative integers, such that all 
columns have the same height, and a new entry on row i will get the value —i. After 
performing the sorting procedure, the above observation implies that we can remove 
all boxes with negative entries from the result and recover a key tableau with the 
same shape as T. □ 


Note that Lemma 15 implies that if T is a key tableau, then one can remove any 
column from it, reorder the entries in each column and obtain another key tableau. 
In some sense, key tableaux behave similarly to a strictly column-closed family of 
tableaux. 


Example 16. Here we illustrate the sorting procedure described in Lemma 15. We 
start with the tableau T which is then augmented with negative integers. 


00 

5 

4 

1 

4 

3 

2 

2 

6 

6 

5 


7 

4 




00 

5 

4 

1 

4 

3 

2 

2 

6 

6 

5 

-3 

7 

4 

-4 

-4 


The second column is then sorted and the entries in the other columns are permuted 
in the same fashion. Two more steps are performed to sort the remaining two 
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columns. 


00 

6 

5 

-3 

4 

4 

-4 

-4 

6 

5 

4 

1 

7 

3 

2 

2 


3rd column 


00 

6 

5 

-3 

4 

4 

4 

1 

6 

5 

2 

2 

7 

3 

-4 

-4 


4th column 


00 

6 

5 

2 

4 

4 

4 

1 

6 

5 

2 

-3 

7 

3 

-4 

-4 


Removing the boxes with negative entries now yield a proper key tableaux with the 
same shape and basement as T. 


Remark 17. Note that Lemma 15 does not generalize to arbitrary semi-standard 
augmented fillings. For example, it is impossible to remove the first column in 
Example 11 and reorder the entries in the remaining non-basement columns into a 
valid SSAF — the Is always appear in some attacking configuration. 


4.2. Key polynomial recurrence. We are now ready to state one of the main 
result of this paper. 

Theorem 18. The sequence of polynomials {/Cfc a (x)}^_ 1 satisfy a linear recurrence 
with 

m-^ T ) 

T 

as characteristic polynomial, where the product is taken over all key tableaux of 
shape a such that columns of equal height have the same filling and multiple roots 
in the product are ignored. 


Proof. This follows almost immediately from Proposition 6, except that KTAB is not 
a strictly column-closed family. However, Lemma 15 implies that the tableaux that 
appear in the product Eq. (9), can be rearranged to key tableaux, while preserving 
the weight of the tableau. □ 


5. The polytope side 

In this section, we show that the integer point transform of polytopes with the 
integer decomposition property, (IDP), satisfy a linear recurrence. In particular, this 
can be used to give an alternate proof of Theorem 18. 

An integral polytope is the convex hull of a finite set of integer points in R d . The 
fc-dilation of a polytope V is defined as kV = {kx : x G V} where k is a non-negative 
integer, and it is easy to see that this is an integral polytope if V is. Furthermore, a 
polytope V is said to have the integer decomposition property if for every integer 
k > 1, every lattice point x G kV fl can be expressed as x = xi + ■ ■ • + xt 
with x,; G V. Note that only integral polytopes can have the integer decomposition 
property and that every face of a polytope with IDP is also a polytope with the 
IDP. 

The following proposition shows that certain polynomials obtained from polytopes 
satisfies a linear recurrence. The argument is very similar to that in Lemma 3. 

Proposition 19. Let V be an integrally closed polytope in R d and let Pfc(z) be the 
polynomial defined as 

pdz) = J2 zX - 

xefc'P nz^ 


( 17 ) 
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Then the sequence pj( z) for j = 0,1,... satisfies a linear recurrence with character¬ 
istic polynomial given by 

n (*- zx ) 

xe'PnZ'* 


Proof. Since V has the IDP, one can easily show that every lattice point in kV 
can be expressed as a sum of a lattice point in (.k — 1)V plus a lattice point in V. 
Therefore 

'Pk(z) ~ ( 

\xevnz d J 

is a polynomial with only negative coefficients corresponding to points in kV that 
are expressible in more than one way as x + y with x in (k — T)V fl Z d and y in 
V fl Z d . Hene 


Pk( z) 



Pk- i(z) + 


E zX 

x^yGVr\Z d 



Pk- 2(z) 


is again a polynomial with positive coefficient corresponding to lattice points in 
kV expressible in at least three different ways. Repeating this argument using the 
principle of inclusion-exclusion then yield the desired formula. □ 


The polynomial defined in Eq. (17) for k = 1 is commonly known as the integer- 
point transform of V. 

The intersection of two faces of a polytope is also a face (of possibly lower 
dimension) of the polytope. This enables us to generalize Proposition 19 slightly: 

Corollary 20. Let V be a polytope with the integer decomposition property and let 
F\,..., Fi be faces of V. Define the sequence of polynomials 

Pk( z) = E zX ( l8 ) 

xefe(u»Fi)nz d 

Then the sequence pj( z) for j = 0,1,... satisfies a linear recurrence with character¬ 
istic polynomial given by 

n (*- zx ) 

xe(UiFi)n7. d 


Proof. The integer point transform of each face F, satisfy a linear recurrence under 
dilation by k, and the polynomials in Eq. (18) can be expressed (via inclusion- 
exclusion) as a linear combination of such integer point transforms of faces. □ 

In [KST10], it was proven that key polynomials (Demazure characters) can be 
expressed as (a certain specialization of) the integer point transform of a union of 
faces of a Gelfand-Tsetlin polytope. Such polytopes are known to have the integer 
decomposition property, see e.g. [Ale 14], so Corollary 20 implies a weaker version 
of Theorem 18. Note that the linear recurrences allow us to define /Co a (x) and it 
follows from the polyhedral complex interpretation that this always evaluates to 1 
(there is exactly one lattice point in the union of faces with dilation 0, namely the 
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origin). It would be interesting to see a direct proof of this fact without using the 
polytope interpretation. 

After extensive computer experimentation, it is hard not to ask the following 
question: 

Question 21. Does the polynomial k H> K-ka{ l n ) always have non-negative coeffi¬ 
cients? 

The case when a is a partition corresponds to a Schur polynomial and it is known 
that 

s x (i") = n A ' ~ +i ~' 

- L - L 1 — l 

where n is the number of variables. This gives a positive answer to the question in 
this case. 


6. The operator side 

Some families of polynomials, such as the Schubert and key polynomials can be 
defined via divided difference operators. Let Si denote the transposition (i, * + 1) and 
let such transpositions act onZ[ii,...,] by permuting the indices of the variables. 
Define the divided difference operators 

Oi " , 7 Ti — 3 j X j . 

x i x i+l 

Given a permutation w £ S„, it can be expressed as a product of transpositions, 
u> = sq * • • Si r When the length l is minimal, we say that ii *2 ... q is a reduced word 
of lo. Then, let d n = <9,;, ■ ■ ■ d tl and ■ ■ ■ 7r i; . It can be shown that these 

operators does not depend on the choice of the reduced word. 

The key polynomials may now be defined [RS95] as /C a (x) = ftu^x^ 01 ’, where 
A (a) is the partition obtained by sorting the parts of a in decreasing order and 
u(a ) is a permutation that sorts a into a partition shape. That this indeed is 
equivalent to the definition above was proved in [Mas09]. We will now give yet 
another proof that the key polynomials satisfy linear recurrences. First, note that 
x fcA is a geometric series as k = 0, 1 ,... and thus satisfy a linear recurrence with 
characteristic polynomial t — x A . Now note that if {/fc(x)})*? 0 satisfy a linear 
recurrence, then so does {<9i/fc(x)}£T 0 and {7ri/fc(x)}^T 0 . The result is now a 
consequence of induction. 

The Schubert polynomials , ©^(x), indexed by permutations in S n , are defined in 
a similar fashion, 

©w( x ) — d ( w ~ 1 wo) x l x 2 ■ ■ ■ x n — 1 

where ojq is the longest permutation in S n , namely (n,n — 1,..., 1) in one-line 
notation. Using a similar reasoning as for the key polynomials, one can produce 
sequences of Schubert polynomials that satisfies linear recurrences. 
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7. Appendix: Some families of column-closed fillings 

In this section, we review some common families of column-closed fillings, related 
combinatorial statistics and generating functions over subsets of such families. Some 
statements here are well-known or very easy to show, so we present them without 
proof. Proposition 6 implies that all these polynomials we define below satisfy linear 
recurrences. 

7.1. Flagged skew semi-standard Young tableaux. Let A and /a be partitions 
with at most l parts, such that Dfi. Let SSYt(A/V, n) be the set of fillings of 
Dx/n with entries in [n], such that each row is weakly increasing and each column 
is strictly increasing. Then for every l and n, the families 

[J SSYT(A/^,n) and [JsSYT(A,n) 

A Dfi x 

are strictly column-closed families, where the unions are taken over shapes with at 
most l rows. On any filling T with entries in [n], we define the statistic w(T) : T —> 
N n such that if w(T ) = (uq ; ... ,w n ), then Wi is the number of boxes in T filled 
with i. It is evident that w is a linear statistic. 

Finally, the skew Schur polynomials in n variables, indexed by skew partition 
shapes A/p i, are defined as 

sa//x(x) = X “ (T) ' 

T£SSYT(A///,n) 


Even more general, let A 2 M be a shapes with at most l rows and let a 
and b be increasing sequences of integers of length l, such that cq < bi for all 
i. Let SSYT(A/p, a, 6, n) C ssyt(A//z, n) be the subset of fillings T, such that 
< T(i,j) < bi for every box (i,j) G Then for each n, 

[J SSYT(A/p,a, 6, n) 

ADji 

is a strictly column-closed family, where the union is taken over all A D /i with 
at most l rows. The row-flagged Schur polynomials, a in n variables are 
defined as 

Sa/^ a,b(x) = ^2 X w(T) , 

TesSYT(\/fi,a,b,n) 

see e.g. [Wac85] as a reference. 

7.2. Symplectic fillings. The following definition is taken from [Kin76] and these 
polynomials are related to representations of Sp(2n). The symplectic Schur polyno¬ 
mials, sp A (x), in the variables XijXf 1 ,..., x^ 1 are defined via fillings of the Young 
diagram A using the alphabet l<T<2<2<---<n<n such that rows are 
weakly increasing, columns are strictly increasing, and entries in row i are greater 
than or equal to i. Then, for a partition A with at most n parts, 

SP,M= X x”V) x —®<T| 

Tg spyt(A) 
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where w(T) is the weight only counting unbarred entries and w(T) only counts the 
barred entries. It is quite clear that the symplectic Young tableaux form a strictly 
column-closed family, and that the statistics w and w are linear. Consequently, 
{sPfcAJ-feLi satisfies a linear recurrence for every fixed partition A. 

7.3. Set-valued tableaux and reverse plane partitions. The Grothendieck 
polynomials 2 G A (x) can be defined (see [Buc02]) as 

G a (x) = E (—1)I T H A I X U '( T ) 

TesvT(A) 

where the sum is taken over set-valued Young tableaux. These are defined as fillings 
of a diagram of shape A, but now each box contains a set of natural numbers. For 
two such sets A, B we have A < B if max A < min B and similar for A < B. 
With this notation, SVt(A) is the set of all set-valued tableaux (subsets of [n]) such 
that rows are weakly increasing, and columns are strictly increasing. Here, the ith 
component of w(T) is now the total number of sets where i appears, and |T| is the 
sum over all cardinalities of the sets in the boxes. Note that the lowest-degree part 
of G a (x) is the usual Schur polynomial s A (x). 

There is also an operator definition of the more general Grothendieck polynomials 
which are indexed by permutations and similar to the Schubert polynomials and 
introduced by Lascoux and Schiitzenberger in 1982. 

To show that G A (x) satisfy a linear recurrence, one needs to use the more general 
version of Lemma 4, since the family of set-valued Young tableaux is not a weakly 
column-closed family; only columns where each set is a singleton can be duplicated. 
However, we note that the family is well-behaved and that every tableau T £ SVT(kX) 
contains duplicate columns for every k sufficiently large. These observations together 
with Lemma 4 allows us to deduce that the Grothendieck polynomials also satisfy a 
linear recurrence. We leave the details as an exercise to the reader. This can also 
be proved using the divided difference operator definition, similar to the Schubert 
polynomials. 

Lam and Pylyavskyy [LP07] proved that the dual stable Grothendieck polynomials, 
g A (x) in n variables can be defined as 

gA ( X )= E x6U(T) 

TeRpp(A) 

where RPP(A) is the set of reverse plane partitions of shape A, that is, fillings of 
A with numbers in [n] such that rows and columns are weakly decreasing. The 
statistic ev(T)i is the total number of columns where i appears. Evidently, ev is a 
linear statistic and reverse plane partitions is a well-behaved, strictly column-closed 
family of fillings. Consequently, we get a linear recurrence in this case. 


2 These are called the stable Grothendieck polynomials. 
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7.4. A note on Jack and Macdonald polynomials. A consequence of satisfy¬ 
ing a linear recurrence, is that the sequence of polynomials must satisfy a linear 
recurrence under every specialization of the variables. In particular, if we pick a 
specialization such that all roots of the characteristic polynomial become equal to 
1, then the resulting sequence is a polynomial. For example, k i —> JCka( l n ) is a 
polynomial in k. 

This observation allows us to deduce that the Jack polynomials Ja(x, a) do not 
satisfy a linear recurrence for general values of a, the sequences Jk\(l n , a) are not of 
the form given in Eq. (5). This observation holds for both standard normalizations 
of Jack polynomials. 

It follows that there are no linear recursions for Macdonald polynomials either, 
since the Jack polynomials are a specialization of the Macdonald polynomials. 
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